This document was downloaded and archived from http://itrb.gov/itrbpmp.htm on May 30, 2001. |
Project Management
for Mission Critical Systems
A Handbook for Government Executives
© 1997 The Information Technology Resources Board
Last edited June 1, 1998
About the ITRB
In July 1996, Executive Order 13011 established the Information Technology Resources Board (ITRB) to assist agencies in the procurement, development and management of major information systems. ITRB members are practitioners drawn from civilian and defense departments and agencies who bring management, technical, and acquisition perspectives to the table. Under the sponsorship of the Office of Management and Budget, the ITRB conducts independent peer assessments of selected Federal information systems. The ITRBs activities promote measurable improvements in mission performance and service delivery to the public through the strategic application of information technology.
Members of the ITRB
Mary Ellen Condon, Chair
Kathleen Adams
Sandra Borden
Arnold Bresnick
Tim Carrico
Kevin Carroll
Kay Clarey
Mark Day
Ken Heitkamp
George Hyder
Myron Kemerer
Mike Laughon
Jean Lilly
Emory Miller
Valerie Wallick
ITRB Staff
Jake Asma
Sandra Hense
Ginni Schaeffer
Department of Justice
Social Security Administration
U.S. Coast Guard
Department of Labor
Federal Aviation Administration
U.S. Army
Department of the Treasury
Environmental Protection Agency
U.S. Air Force
Office of Personnel Management
NASA
Department of the Interior
Internal Revenue Service
General Services Administration
U.S. Navy
General Service Administration
General Services Administration
General Services Administration
About this Handbook
This handbook is derived from actual reviews of mission critical Federal information systems projects. It sets out a concise,
high-level framework for project management. Within this framework is provided a series of practical suggestions for Federal
executives involved in management of mission critical information systems.
The following pages are not intended to be exhaustive. Rather, they provide a quick, sensible overview of useful practices and
tools for the effective management of information systems projects.
The ITRB is committed to results. We hope you find this handbook to be useful.
Mary Ellen Condon
Chair
Information Technology Resources Board
Executive Summary: Making Projects Work
Meeting the Mission
Align the Project Mission with the Agencys Mission
Know the Project Stakeholders
Amplify the Voices of Your Customers
Maintain High-Level Communication About the Project Mission
Set Realistic Business Objectives
Define a Sound Architecture
Gain Agreement on the Project Plan
Organizational Leadership
Project Leadership
Project Team Members
Appendix: Tools for the Toolbox
Executive Summary: Making Projects Work
Project management delivers results. The practice of project management can focus efforts on your mission by aligning
priorities, leveraging resources, and delivering services to customers. A successful project translates a broad public mission
into concrete results and outcomes. The following issues are critical for making projects work.
Meeting the Mission: Why are you undertaking this project in the first place? Who are the stakeholders and the customers? What are their expectations for the project? How does the project mission fit into your agencys mission?
All activity on a successful project supports a well-bounded, agreed upon mission. As a project progresses, it is often necessary to take a step back and realign individual project elements with one another and with the project mission. Successful projects strike a balance among strategies, people, and processes.
Strategies: What do you want to accomplish with this project? Articulate the business objectives, the technical environment, and the project plan.
People: Who are the project participants, and how are they organized? Communicate with the organizational leadership, the project leadership, the team members, the stakeholders and the customers.
Processes: How will the project accomplish its objectives over time? Define the planning processes, the technology management, and the control of tasks.
Project management provides a proven way to set priorities and achieve results. Make use of project management to gain a realistic perspective on the "big picture," to maintain focus on priorities as they evolve, and to help sort out what must be done to make the project a success.
Meeting The Mission Its why youre here Align the Project Mission with the Agencys Mission What is your agencys mission? What is the relationship of your
project to your agencys mission? Project activities need to
support this mission. A strong project mission can not be created in a vacuum. Who are
the people with an interest in the outcome of the project? What
are their common expectations? Stakeholders expectations are
rarely spelled out in legislation, executive orders, or formal
memoranda. Who will be paying for this project? Who will actually be using the
systems and processes being designed? Clarify the business
priorities of these customers and their criteria for success. Actively
and emphatically communicate this information. Do this for
customers inside the organization as well as those outside the
organization. Communicate steadily with stakeholders and customers throughout the project. This will help to manage their expectations and requirements over time. Design project development so that requirements and expectations can be reconfirmed at regular junctures. Periodically check to see that stakeholders and customers understand and support changes, delays, and new developments.
Strategies What are the common business needs of the organizations that will
depend on the system? What accomplishments will be critical for
the project to be considered successful? Define project
boundaries at the outset, and use this definition to manage
requirements throughout the project. A clear definition of business
success will also help ensure that project efforts support the
agencys strategic plan. Drive Toward an Enterprise-Wide Business Model Ensure that the business model meets business objectives while
remaining within the projects scope. Publish a detailed concept of
operations which distinguishes clearly among the business model,
the layout and relationship of systems and communications, and
the technical architecture. These should be anchored in an
enterprise-wide IT strategy. Work toward a systems implementation that will deliver, in twelve months or less, incremental, useable levels of functionality which support specific business objectives. The detailed concept of operations should explain how the architecture will satisfy these objectives and how it will prioritize them. It should also communicate responsibilities for implementing and managing the architecture. Coordinate Technical Standards Which standards are essential to ensure that the technical architecture ultimately supports business objectives? Define these, paying particularly close attention to technical interfaces. Develop a plan to ensure compliance with architecture standards. The technical architecture must be documented to ensure its consistency with the overall agency-level design. Gain Agreement on the Project Plan The project plan formally captures and documents agreements among customers, stakeholders and project participants. Secure an informed agreement up front, and maintain this agreement throughout the project life. This will ensure that the project meets expected results. This will also help align the project with the organizations business plans and supporting IT plans. Over time, manage the project scope carefully, since there will be a tendency for different areas of the project to acquire their own divergent momentum.
Listen to the Customer and Create a Vision The project sponsor manages high-level customer relationships, translating key customer expectations into a practical vision for the project. To be effective, this vision must be broadly communicated. Commit to the Project The most frequent cause of project failure is the lack of
involvement of the organizational leaders. Ongoing involvement is
crucial. It is critical to structure the project in such a way that
go/no-go decisions may be made at highly visible milestones.
Leadership commitment stabilizes the project so that it can
accommodate changes over time. The roles and responsibilities of the project and its partners are
most effective when they correspond with the way in which the
overall agency is managed. For example, in an organization in
which field offices have a great deal of autonomy, a centralized
approach to IT management could bring about unnecessary
conflict. The Chief Information Officer (CIO) position requires extraordinary qualifications in both IT management skills and general management skills. The CIO needs authority and visibility to guide the organization in key decisions. The CIO focuses on three things:
Select a Strong Project Manager Empower a central point of responsibility for project decisions, and clearly distinguish this role from functional program management roles. Clarify the risks which the project manager is expected to manage strategically. "Leadership ability" is difficult to articulate, and even more difficult to find. At a minimum, it includes the following characteristics:
Enable a Cooperative Environment Nurture cooperation among members of the leadership, including
the project sponsor, functional program manager, project
manager, contracting officer and contractor. Create a learning
environment which attracts individual skills to the table. Actively
encourage team members to innovate by rewarding judicious
risk-taking. The project manager is responsible for results. Successful project managers actively encourage team members to make minor challenges known before they become major problems. The project needs a "truth culture" let the messenger live. Stress the importance of accountability by systematically introducing constructive criticism into current practices. One recommended technique is to outsource for independent validation and verification (IV&V) support. It is critical for the executive leadership to listen to IV&V advice. Another technique is to create an anonymous channel for reporting problems. Get Whats Needed to Succeed What are the competencies of the team? How does the staffing
plan distribute these competencies against project tasks? Assess
the teams particular strengths, then get the additional expertise
needed. There may be a need to outsource for additional skills to
round out the team. Balance the mix of management and technical
expertise, and the mix of contractor and government personnel.
Distinguish between critical strategic activities and tactical
activities. Make use of consultants to leverage the teams
capabilities. Maintain a commitment to the integrity of the core team. The
project should include the project manager, the functional program
manager, the contracting officer and other key players from
project conceptualization through implementation. Empower a
central point of responsibility for technical decisions, including
standards and architecture. How does the level of effort contribute to project deliverables and
results? How is the team progressing against the project plan?
Perform periodic cost-benefit analyses and life cycle cost
estimates. This information will be needed for go/no-go decisions
at major project and contract milestones. Invest in building competencies in key people. Institute and follow a formal plan for skills training and career development. Align the competencies of team members with the long-term needs of the project.
Define Success Up Front Define project success in terms of specific business objectives.
From the customers point of view, how should different business
objectives be prioritized? Focus on outcomes rather than outputs. Prioritize the metrics for
which project participants will be held responsible. Gain
agreement on critical metrics and use them to drive planning and
delivery. Formalize planning processes. Assign roles and responsibilities
specifically for planning-related activities. The CIO can help
anchor project plans in the organizations business and IT plans. How will plans need to be modified along the way? Make sure project plans continue to support intended business priorities. If the project encounters significant changes, then the original plans will have to be realigned to ensure desired results. Choose an Appropriate Development Model Base selection of a development model on careful consideration of four factors:
Select an Appropriate Life Cycle The life cycle provides an organizing structure with which to align
project objectives with appropriate technologies and resources.
Different projects require different degrees of rigidity in the
sequencing of their phases. Long, complex projects intended to
modify familiar systems typically yield to more rigid sequencing.
On the other hand, less rigid sequencing may be required to
achieve a series of innovations under conditions of high
uncertainty. Business needs may change. All requirements must be formally
managed. Address downstream changes in the life cycle through
systematic risk assessment. Project participants need a clear idea of how well the project plan
is working. Establish a set of key progress indicators and make
them visible to all project participants. Dont simply automate existing processes. Rethink existing
processes instead of simply "paving the cowpaths." If your agency
lacks the skills, use consultants to facilitate business process
reengineering (BPR) and information modeling prior to defining
requirements.
Put Meaning in the Metrics Define requirements so that they may be thoroughly tested and validated at the unit and systems level of granularity. Identify frequent milestones with a defined set of measurable pass/fail performance criteria. Structure related contracts so that they reflect the same units, granularity, and milestones. This enables you to measure earned value throughout the contract life. These criteria should comply with a pre-established test plan. Leverage Expertise in Control Areas
|
One ITRB-reviewed project was situated within an agency which had recently undergone major budget reductions and large-scale structural changes. Because senior management was unclear about customer expectations, the agency had been unable to articulate a clear strategic view of the project and its role in the new environment. Customers had insufficient information to guide them in improving work processes. The ITRB recommended that the agency work with customers to accelerate development of a new strategic plan, and that it publish a concept of operations to communicate how the system would operate in future years.
One ITRB-reviewed project reversed its
declining fortunes by making substantial
revisions to project requirements several
years into the project. Project leaders had
conducted an evaluation of
requirements, leading to large but
necessary reductions in both scope and
requirements. Though initially
disorienting, this reduction did much to
stabilize the project, leading to a
significantly improved outlook for
project success.
The ITRB encountered a project which, after eight years of planning, had yet to define an architecture. The project had come to rely heavily upon the functional program knowledge of the technical contractor, and there were insufficient technical resources involved in crucial technology decision-making. The ITRB recommended that the organization establish technical requirements for deliverables, define modular delivery of specified interim products, monitor product delivery, and generally strengthen the role of contract management.
The architecture should provide a focal point for project definition and clarity. Indeed, ambiguity surrounding this fundamental concept may be a clue that your architecture requires attention. One ITRB-reviewed project exhibited a number of inconsistencies in its use of the term "architecture." This led to conflicting expectations when information about the architecture was disseminated among project participants. Upon closer inspection, the ITRB found that the architecture required broad realignment with the organizations strategic plan and budget.
One ITRB-reviewed project had
negligible high-level involvement on the
part of its organizational leadership. It
turned out that no single individual was
accountable for providing such
leadership. Among other things, this
explained the absence of a formal
planning process and clear business
objectives.
The ITRB encountered one project which had clearly identified the information needs of key stakeholders, but was having great difficulty prioritizing these needs. The centralized organization running the project simply did not have the resources or the authority to provide an enterprise-wide solution to all of its widely distributed lines of business. Among other recommendations, the ITRB noted the need to establish an agency-level CIO who could focus the project architecture on the most critical common needs of the different lines of business.
The Clinger-Cohen Act identifies four core competency areas for CIOs: 1. Federal Information Resources
Management
Project leadership does not simply appear; it must be nurtured. Among all of the projects reviewed by the ITRB, those with the greatest chance for success were those which sought to grow and develop leadership competencies over the long run. Though many aspects of project management may be reduced to defined processes, the development of project management leadership competencies remains a difficult but worthwhile challenge.
One ITRB-reviewed project exhibited no
partnership among functional program
leaders, IT managers and contract
managers. Significant confusion resulted
among both contractor and agency
employees as to who made key
decisions. In the absence of cooperative
leadership, critical analysis of functional
requirements was seriously lacking. The
ITRB recommended that the project not
only clarify the respective roles of
project team members, but that it
reorganize its executive steering
committee to make it truly accountable
for all final project decisions.
One ITRB-reviewed project found a significant shortage of staff on the agency management team. The ITRB recommended that the management team take all possible actions to expand its staff, concentrating on the addition of technical expertise in computer software and systems. The ITRB also recommended that contract personnel be more effectively used to provide project management support
One ITRB-reviewed project revealed a clear need to integrate IT planning across various organizational units involved in the project. A new business concept of operations required that IT processes be realigned to meet evolving demands. The ITRB recommended that the organization use experts in BPR and information modeling to facilitate the necessary process analysis and redesign
One agency requested the ITRB review
its enterprise-wide architecture. The
agency appeared to lack a structured
process for testing products within the
architecture before placing them into use.
The ITRB recommended a centralized
test bed which would enable the agency
to simulate new functionalities and
assess them before placing them into
service.
One ITRB-reviewed project faced serious
risk of failure due to recent major shifts in
the agencys mission. If carried out
according to the original plan, the project
would simply have automated certain
processes which no longer made sense
in the new environment. The ITRB
recommended that the organization cease
development of certain sub-systems, and
retain consultants to facilitate high-level
process redesign.
The ITRB reviewed one project which
had recently negotiated movement from a
cost reimbursement contract to a fixed
price contract. While the ITRB
concluded that this was an appropriate
step, it noted that the agency would
need to consider more thoroughly the
different risks entailed by the new
contract incentives, and that it would
need to balance the risk between the
agency and the contractor. For example,
the ITRB recommended that the agency
tie progress payments to
accomplishment of specific milestones.
One recently redesigned project lacked test and acceptance procedures for a large set of new technical requirements. The ITRB recommended that the agency establish test and acceptance procedures at frequent milestones consistent with the projects work breakdown structure. It further recommended that the requirements be re-baselined, and frozen, in order to ensure an acceptable level of functionality.
The ITRB reviewed a project whose software development process was in a perpetual state of change. The ITRB recommended the establishment of configuration management baselines as well as cost and schedule baselines.
|
DO YOU HAVE SUGGESTIONS AND COMMENTS ABOUT THESE TOOLS FOR THE TOOLBOX?
Best Practices
DOD Software Program Managers Network
PO Box 2523
Arlington, VA 22202
(703) 521-5231
http://www.spmn.com
spmn@aol.comFederal CIO Council
http://www.cio.gov
ciocouncil.support@gsa.gov
"Information Technology Investment First Practices "
ftp://cio.gov/www/cio/firstpra.docGeneral Accounting Office (GAO)
441 G Street, NW
Washington, DC 20548
(202) 512 - 3000
http://www.gao.gov/
documents@gao.gov
Key Managerial Competencies
Federal CIO Council
Project Management Institute
130 South State Road
Upper Darby, PA 19082
http://www.pmi.org
"Guide to the Project Management Body of Knowledge"
http://www.pmi.org/pmi/publictn/pmboktoc.htm
Training Resources
Defense Systems Management College
9820 Belvoir Road
Fort Belvoir, VA 22060-5565
(703) 805-3666
http://www.dsmc.dsm.milFederal Acquisition Institute Online University
General Services Administration
18th and F Streets, NW
Washington, DC 20405
http://www.gsa.gov/staff/v/mvi/key.htm
acquisition@gsa.govGeorge Washington University
Program in Project ManagementDepartment of Management Science
Building AL
2101 F Street, NW
Washington, DC 20052
(202) 994-6145
http://www.sbpm.gwu.edu/Programs/mspm/index.htmGeorge Washington University
Staff Development CoursesQuality Management Resources
George Washington University
2011 Eye Street, Suite 200, NW
Washington, DC 20052
(202) 973-7670
http://www.gwu.edu/~qmr/qmr_html/qmr1.html
vsa@gwis2.circ.gwu.edu1000 by the Year 2000 Program
General Services Administration
18th and F Streets, NW
Washington, DC 20405
(202) 208 -2780
http://www.itpolicy.gsa.gov/mkp/1kby2k/1x2intro.htmGSA Trail Boss Program
General Services Administration
18th and F Streets, NW
Washington, DC 20405
(202) 219-2354 or (202) 501-1136
http://www.itpolicy.gsa.gov/mkp/trailbos/trailbos.htmNational Aeronautics and Space Administration
Program/Project Management InitiativePPMI Program Officer
Headquarters Code FT
Washington, DC 20546
(202) 358-2182
http://www.hq.nasa.gov/office/codef/codeft/USDA Graduate School
1400 Wilson Boulevard, Suite 1000
Arlington, VA 22209-2312
http://grad.usda.gov
pubaffairs@grad.usda.gov
Performance Measurement
DOD Software Program Managers Network
PO Box 2523
Arlington, VA 22202
(703) 521-5231
http://www.spmn.com
spmn@aol.comCarnegie Mellons Software Engineering Institute (SEI)
4500 Fifth Avenue
Pittsburgh, PA 15213
(412) 268 - 5800
http://www.sei.cmu.edu/
customer-relations@sei.cmu.edu
Table of Contents | Beginning of Document |
Comments about this site may be sent to the UNT Libraries Government Documents Department.